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1 .   Introduction 

In  a  previous  paper  [1]  the  author  has  compared  and 
contrasted  cross-sectional  and  longitudinal  manpower  flow  models. 
The  cross-sectional,  or  Markov,  model  requires  relatively  little 
data  and  has  been  widely  analyzed  (see,  for  example,  [2]  and  [3]). 
The  longitudinal  model  incorporates  more  realistic  personnel 
flows,  but  requires  extensive  data  which  is  not  always  available. 
In  [4]  Hayne  and  Marshall  analyze  a  two-characteristic  cross- 
sectional  model  which  can  be  viewed  as  a  hybrid  of  the  Markov 
and  longitudinal  models.   In  Chapter  5  of  [3]  Grinold  and  the 
author  present  some  long-range  optimization  models  based  primarily 
on  the  longitudinal  model. 

The  purpose  of  this  paper  is  to  show  how  efficient 

computational  methods  can  be  used  with  the  two-characteristic 

model  by  exploiting  the  special  structure  of  its  underlying 

matrix.   These  methods  make  possible  the  efficient  use  of  this 

basic  flow  model  in  optimization  models  similar  to  those  described 

in  [3].   This  paper  explores  this  application  in  detail  when  the 

two  characteristics  of  the  state  are  grade  and  time-in-grade . 

Approximate  solutions  are  found  to  infinite  horizon  linear 

programs  using  methods  similar  to  those  in  [3] . 

This  paper  relies  heavily  on  the  notation 

and  results  in  [3]  and  [4].   The  reader  is  referred  there 

for  details.   Section  2  contains  a  formulation  of  the 

optimization  model  and  its  approximation  (see  [3],  Chapter  5, 


pages  186-209) .   Section  3  contains  results  on  the  structure 
of  the  flow  matrices,  their  generating  function  for  the 
(Grade,  Time  in  Grade)  model,  and  the  legacies  and  their  generating 
function.   Section  4  describes  efficient  methods  of  computation 
for  these  generating  functions.   Section  5  gives  a  simple  numeric 
example  which  the  reader  may  wish  to  follow  simultaneously  with 
the  theory  in  Sections  3  and  4.   The  example  has  been  kept  small 
and  simple  because  of  space  limitations  and  for  ease  of  exposition. 


2 .   Model  Formulation 

It  is  assumed  that  manpower  joins  a  system  on  one  of 
K   chains,  and  at  some  discrete  time   t   is  counted  in  one  of 
n   classes  if  it  is  still  in  the  system.   Let   P(u)   be  an 
n  x  k  matrix  with  element   p.  .  (u)   equal  to  the  fraction  of 
manpower  that  enters  on  chain  j  which  is  in  class  i,  u  periods 
after  entering  the  system.   The  matrices   P(0),  P(l),  ... 
describe  the  flow  through  the  system. 

Let   g(u)   be  a  K-element  column  vector  of  flows 
into  the  system  on  each  chain  at  time   u  =  1,2,...;  let  Mu) 
be  an  n-element  column  vector  of  legacies  in  each  class  at  time 
u  =  1,2,...   of  manpower  which  enter  up  to  and  including  time 
t  =  0,  which  is  taken  to  be  the  current  time.   If   s (t)   is  an 
n-element  vector  of  stocks  in  each  class  at  time   t  =  1,2,..., 
then 


t 

(1)  s(t)  =  I      P(t-u)  g(u)  +  lit) 

u=l 


In  [3]  Grinold  and  Marshall  used  this  chain-flow  model 
as  the  basis  of  a  linear  optimization  model  (see  Chapter  5) . 
Let   a   be  a  discount  factor,  a   an  n-element  vector  of  one- 
period  costs  on  stocks,  b   a  K-element  of  one-period  costs  on 
new  hires,   p  the  constant  size  of  the  system,  A   a  constraint 
matrix  on  stocks  and   B   a  constraint  matrix  on  flows.   Finally 
let   e   be  a  vector  with  all  elements  equal  to   1. 
Consider  the  infinite  horizon  linear  program  (LP) 


.  .  .      r    t 
Minimize    \      a    [as(t)  +  bg(t)] 

t=l 

PI. 


t  -  1,2, 


It  is  shown  in  [3]  that  the  solution  to  a  K-variable 
single  period  problem  can  be  used  to  generate  solutions  to  PI 
which  are  usually  optimal  and  always  good  approximations.   Let 

~       °°  ~       °°  ^ 

P(a)  =  I      auP(u),     £(a)  =  I      aU    £(u)  and   c  =  aP(a)  +  b 
u=0  u=l 

Then  by  using  (1)  to  eliminate   s(t),  and  multiplying  the  t-th 
period  constraints  in  PI  by   a    and  summing,  we  obtain 


P2.  Minimize   eg 

Subject  to:   eP(a)g  =  [ap/(l-a)]  -  el(a) 

AP  ( a )  g  >  -M  (a  ) 

Bg  >  0 

g  >  0 

This  LP  has  only  K   variables   g.   Let   g*   be  the  optimal 
solution  to  P2.   In  [3],  Chapter  5,  it  is  shown  how  scalars 
y(l),  y(2),...    can  easily  be  found  successively  such  that,  if 
we  let   g*(t)  =  y   (t)g*,  then  these   g* (t)   are  often  optimal 
in  PI  (they  are  optimal  if   A   is  vacuous) . 

The  purpose  of  this  paper  is  to  analyze  the  structure 
of    P(a)   and  1(a)       in  P2   when 

(i)   The  system  can  be  partitioned  into  a  hierarchical 
structure  of  grades 
(ii)   A  two-characteristic  cross-sectional  flow  model  is  used 

with  a  state  described  by  the  2-tuple  (Grade,  Time  in  Grade). 
This  is  called  the  (G,  TIG) -model, 
(iii)   Entering  a  chain  corresponds  to  entering  a  grade,  necessarily 
with  TIG  equal  to  1. 
(iv)   A  class  corresponds  to  a  grade. 
We  use  the  results  of  Hayne  and  Marshall  in  [4]  for  the  (G,TIG) 
model.   For  example,  in  a  simple  model  of  a  university  faculty 


the  grades  might  be  Assistant  Professor,  Associate  Professor  and 
Full  Professor.   Let  us  assume  that  the  maximum  number  of  periods 
(years)  a  person  can  spend  in  these  grades  is  6,  30,  and  30. 
The  number  of  states  in  the  (G,TIG)  model  is  66,  so  that  a  cross- 
sectional  flow  matrix,  say   Q,  (66  x  66)  would  have  4356  elements, 
most  of  which  would  have  value  zero.   One  of  the  matrices   P  (u ) 
in  (1)  would  be  3  x  3  with  only  9  elements,  since  chains 
map  onto  grades  with  TIG  equal  to  1  and  stocks  are  also  measured 
only  in  grades.   Any  given  manpower  policy  will  imply  certain 
element  values  for   Q.   In  this  paper  we  show  how  to  find   P(u) 
and   Mu),  and  hence   P(a)   and  I  (a)  ,  from   Q   in  an  efficient 

manner.   Thus  policy  changes  can  be  reflected  in  the  chain  flow 
model  through   Q,  where  the  effects  of  such  changes  on   P(u) 
could  not  be  determined  directly.   A  simple  numerical  example 
is  given  in  Section  5  following  the  theory.   The  reader  may 
wish  to  follow  the  example  concurrently  with  the  theory. 


3.   The  Structure  of   Ma)   and   P(a) 

The  number  of  grades  in  the  system  is   n  (=  K  )  .   Let 

v-n 
the  maximum  time  in  grade  j   be   u(j),  and  let  I   =  Ji  .  ,  u(j). 

Then  I      is  the  number  of  states  in  the  system.   Let   Q   be  the 

one-period  flow  matrix  for  the  (G,TIG)  model.   The  u-period  flows 

are  given  by   Qu.   We  now  relate  the  I   x  £   matrix   Q    to  the 

n  x  n   matrix   P  (u)  . 


Let   r   be  an   n  x  I      matrix  where  row  j  has 

ri  —  1 

(i)   the  first    Z-_t  u(i)   elements  equal  to  0, 
(ii)   the  next   u(j)   elements  equal  to  1, 
(iii)   the  remaining  elements  equal  to  0. 

Let   $   be  an   H  x  n   matrix  where  column  j  has 
(i)   the   (u ( j-1) +1) -th  element  equal  to  1  (element  1  when 

j  =  1) 
(ii)   all  other  elements  equal  to  zero. 

Then  . 


(2)  P(u)  =  TQU$  ,       u  =  0,1,2, ...  . 


n00        U 

Recall  that   P(a)  =  \   _Q    a      P(u).   Using  (2),  if  we  let 


(3)  N(a)    =    (I     -     aQ)     1 


then 

(4)  P(a)    =    TN(a)$    . 

r>°°  11 

Recall    also    that      1(a)    =    j      n    a      £(u). 

Lu=l 

Let  a      be  the  & -vector  of  stocks  of  manpower  in  each 
state   at  time   t  =  0.   Then 

Z(u)    =  TQUa,  u  =  1,2,  ..  . 

and  therefore, 

(5)  Ma)  =  af(N(a)  -  I)a   . 


Notice  from  (4)  and  (5)  that  to  determine   P(a)  and  1(a) 
we  need  to  compute  the  n  *  I   matrix   TN(a).   But  first  we  look 
at  the  structure  of   N(a),  the  inverse  of  the  large  sparse 
matrix   (I  -  aQ) . 

In  [4]  Hayne  and  Marshall  show  that  for  the  (G,TIG)  model 
the  cross-sectional  flow  matrix   Q   has  the  structure 


(6) 


Q  = 


Q. 


n-1 


% 


where   Q    is  a   u(j)  x  u(j)   matrix  and   P.   is  a   u(j+l)x  u(j) 

J  1 

matrix.   All  other  submatrices  of   Q   have  O's  as  elements  and 

are  suppressed.   In  addition  each   Q.   contains  zeros  except 

for  the  lower  diagonal, 


(7)  Q  = 


0 
0 


lJ2 


0     q.  ...    ,    0 


~  a.  f  /.  r  ,  *  *  f    n  * 


Also  each   P.   contains  zeros  except  for  the  top  row, 


(8) 


P.  = 


'jl    PJ2 

0 


],ui]) 
0 


,  j  =  1,2,... ,n-l 


The  inverse  of   (I  -  aQ)   can  be  written 


(9)       N(a)  = 


Nu(a) 


N21(a) 


Nnl(a) 


n,n-l       nn 


where 


and 


N..(a)  =  (I  -  aQ.) 


-1 


N.   =  c^^N.  .  (a)  (P  .  J. 


3i 


m 


j-i  :-i,j-i 


(a)) 


(PiNii(a)) 


for   j  >  i.   Thus   N(a)   is  completely  determined  by  the  inverses 
{N  .  (a)  ,  j  =  1,2,  .  .  .  ,n}. 


Now  let 


(10)    nki^)  =  <3 


,k-l*qj/k-2 qj,i 


for   k  >  i , 


the  product  of  (k-i)  nonzero  elements  of   Q..   Then 


(11)  N^fa) 


an21(j) 


an3l(j) 


n-1      , . N 
u (j)  ,1 


an32(^) 


an  ,M   /  •  i  \  (J)    1 
u(;j)  ,u(;j-l) 


Thus  all  the  elements  of   N. . (a)   are  determined  from  the  partial 
products  in  (10),  and  all  the  elements  of   N(a)   in  (9)  are 
determined  by  multiplication  of  these  with  the  vectors  forming 
the  top  rows  of  the   P.   in  (8).   However,  the  matrix   N(a)   in 
(9)  need  never  be  explicitly  determined  in  order  to  find   P(a) 
and   £(a).   We  make  the  following  observations. 


(12) 


(i)   P.N..(a)   is  a  matrix  with  nonzero  elements  only 
in  the  top  row  (i.e.,  it  has  the  same  structure 
as  (8)). 
'(ii)   If   IT   is  any  matrix  with  the  same  structure  as 
(8)  with  as  many  rows  as   N..(a)   has  columns, 
then   N   (a)n   requires  only  the  first  column  of 

N.  .  (a) 
33 


Now  let 


r  =  Max{u(j),  j  =  1,2,...,  n}  , 


and  let   W(a)   be  an   n  *  r  matrix  with  the  j-th  row  equal  to 
the  nonzero  elements  of   Q.   multiplied  by  a,    preceded  by  a  1 , 
and  O's  added  to  the  right  as  necessary.   Thus 


(13)  W(ot)  = 


1   agilaq12  -..  aq^u(1)_1, 


1   aq2,aq„2 


....  0  , , 

aq2,u(2)-l'0. 


1   aq  , aq  _ 
^nl  ^n2 


aq 


n,u(n)-l 


where  it  has  been  assumed  that   u(l)  <  u(2)  <  u(n)  =  r   for 
clarity.   Similarly,  let   V(ot)   be  an   n  *  r   matrix  with  the 
j-th  row  equal  to  the  nonzero  elements  of   P.   multiplied  by  a, 
with  O's  added  to  the  right  as  necessary,  for   j  <_   n-1,  and 
row   n   a  row  of  O's.   Thus 


(14) 


V(a)  = 


ap-^,  ...,  apiu(l),"**/     °'  

aP2l'  '  ap2,u(2)'0' 


apnl' 


0  , 


,  o 
,  0 


'apn,u(n) 


10 


Finally  let   S   be  an  n  *  r  matrix  of  stocks  at  time  zero,  where 


element   s . .   gives  the  stocks  in  grade  i  with  time  in  grade 
ID 

equal  to  j .   Thus   S   is  a  matrix  representation  of  the  vector  a 


with  O's  added  where  necessary.  Let   T(j)  =  £■_-,  u(i) 


Then 


(15) 


S  = 


a . 


°T(1)+1     QT(l)+2 


aT(n-l)+l   °T(n-l)+2 


aT(l)  ° 


aT(2)  °  •••° 


'T(n) 


All  the  information  required  to  determine  H  (a.)      and   P(a)   is 
contained  in   W(a),  V(a),  and   S.   Both  can  be  found  using  simple 
row  operations  on  these  compact  matrices.  In  the  3  grade,  66 
state  example  given  earlier   V,  W   and   S   are  each  3  x  30  and 
contain  a  total  of  270  elements.   Storage  of  the   Q  matrix  to 
find   (I  -  aQ)     directly  would  require  4356  elements,  and  direct 
inversion  would  necessitate  inverting  a  66  dimensional  very 
sparse  matrix.   Total  storage  for  both   Q   and   a   would  be 
4422  elements. 

4 .   Computation  of   £(g)   and   P(a). 

Let   v   and  w   be  any  two  n-vectors.   We  define  a 
vector-valued  function   F(v,w)   on  these  such  that 

(16)   F(v,w)  =  [(v.  +  w„v„+'«*+  w„w  •  •  «w  v  )  ,  (v0  +  w_v-.+  *  •  «+w  w  •  •  «w  v  )  , 

1     2    2  2    5  nn     2.         5    6  J4     nn 

...  ,  (v     +  w  v  ) ,  v  1  . 
n-1    n  n    n 


11 


We  can  extend  this  function  as  follows.   If   V   and  W 
are  matrices  of  the  same  size,  then   F(V,W)   is  a  matrix   X  with 
the  same  dimensions  as   V   and  W,  and  if   v   and  w   are  the 
j-th  rows  of   V  and  W,  respectively,  then  (16)  gives  the  j-th 
row  of   X.   The  function   F   is  the  key  to  the  efficient  calcula- 
tion of  both  Z(a)      and   P(a),  since  by  using  it  we  can 
efficiently  compute   TN(a). 

Let   U   be  an  n  x  r  matrix  such  that  element  (i,j)  is 
1  if  element  (i,j)  of  W(a)   is  positive,  and  is  0  otherwise, 
where   W(a)   is  given  by  (13).   Also  let 


v .  =  eN .  .  (a)  , 
3  33 


3  1)4(  •  •  •  (Ilj 


the  column  sums  of   N..(a)   in  (11).   Thus   v.   is  a   u(j) -vector 

Now  let   v.   be   v.   followed  by   r-u(i)   zero's.   Then 
3  3 


(17) 


F(U,W(a))  = 


n 


an  n  x  r  matrix. 

Now  let   m.   be  the  top  row  of  the  matrix   P.N..(a), 
j  =  1,2,...  ,  n-1,  a   u(j)-vector,  and  let   m.   be   m.   followed 
by   r-u(j)   zero's.   Then 


12 


(18) 


F(V(a),W(«))  = 


m. 


m. 


m 


n-1 
0 

an  n  x  r  matrix.   Equations  (17)  and  (18)  contain  all  the  required 
data  for   TN(a).   Let   v   be  the  first  element  of  any  vector   v. 
Then  using  the  results  in  (11)  and  (12), 


(19)  TN(a)  = 


1 
v2m 


1  1 

v3m2m1 


11       1 
n  n-1     2  1 


V3m2     V3 


n 


an  n  x  £  matrix. 

Consider  now  the  determination  of   P(a)  -  TN(a) 
(19)  and  the  definition  of   $   we  see  that 


From 
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(20)   P(a)  = 


1  1 
v2m1 


111 
v3m2m1 


1  1 
V3m2 


1  1 


1  1 


n  n-1    2  1 


n 


an   n  x  n  matrix.   This  can  be  constructed  from  the  first  columns 
of  (17)  and  (18) . 

To  determine  1(a)      we  require   TN(a)   and   a.   From 
(19)  it  is  easy  to  see  that  it  can  be  constructed  from  (17),  (18), 
and  (15). 

We  now  illustrate  efficient  APL    functions  to  compute  the 
various  matrices.   The  reader  should  consult  [5]  for  details 
of  APL    programming. 

Let  Ml    and  A/2  be  any  two  matrices  of  the  same  dimension. 
Then  the  APL    function 


V  fl«-Afl  F    142 1 X 
[  1]    *?«-(  *x\M2  +  0  =  fo'2.)  x4>+\4>#lx*+0=X*-x\k"2 

V 

calculates   F(.vi,'/1)   as  defined  by  (16).   Let  V,    W   and  S   be 
APL   variables  for  the  matrices  V  (a)  ,  W(a)  and   S   in  (14),  (13), 
and  (15)  respectively.   Then  (17)  is  given  by  (W   >    0)  F   W,    and 
(18)  by  V   F    W.       If  we  let  these  be  X      and  Y      respectively, 
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and  let  N      be  the  number  of  grades  and  P      be   P(a),  then 


(22)    P«-  (  (  i  .V  )  o  .  >  x  ,v  )  x  ( is?  (  a;  ,  ,v  )  p X  [  ;  1  ]  )  x  x  V  (  x  \  1 1  ,  z  )  ,  [  1  ]  $  ( .1/ ,  .V- 1 )  pZ<-~  1  +  Y C  ;  1  ] 


Finally,  if  A      is  the  APL   variable  for   a,  and  L      the  variable 
for   Ha),  then  from  (5),  and  the  arguments  above 

(2  3)    L+A*{  (+/XxS)  +  (px(  (  ;/v  )o.>;/V)x(<y,/>')piZ,i)  +  .  x+/yxS)-  +  /S. 


5 .   Numerical  Example 

Assume  we  have  3  grades  and  that  the  maximum  time  in 
each  grade  is  3,  4  and  5  periods.   Thus   n  =  3,  u(l)  =  3,  u(2)  =  4, 
u(3)  =  5,  r  =  5.   The  matrix   Q   in  (6)  is  12  *  12  and  contains 
the  following  5  non-zero  submatrices  (see  (7)  and  (8)) 


0 

0 

0 

.05 

.1 

.8 

Ql = 

.9 

0 

0 

Pl    = 

0 
0 

0 
0 

0 
0 

0 

.8 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

.1 

.7 

.95 

0 

0 

0 

0 

0 

0 

0 

Q2    = 

0 

.9 

0 

0 

P2    = 

0 

0 

0 

0 

0 

0 

.85 

0 

0 

0 

0 

0 

0 

0 

0 

0 

Q3  " 


ooooo 

.9  0  0  0  0 

0  .9  0  0  0 

0  0  .8  0  0 

0  0  0  .7  0 
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The  starting  stocks  are  given  in  the  12-vector 

a  =  (100,  73,  70,  82,  65,  63,  58,  59,  48,  30,  25,  20)  . 

Let   a  =  0.9.   Then  from  (13).  (14)  and  (15)  we  have  the  3  x  5 
matrices 


W(a)  = 


1  .81  .72  0  0 
1  .855  .81  .765  0 
1   .81    .81   .72    .63 


V(a)  = 


045 

.09 

.72 

0 

0 

0 

0 

.09 

.63 

0 

0 

0 

0 

0 

0 

s  = 


100  73  70  0  0 
82  65  63  58  0 
59   48   30   25   20 


From  (17)  and  (18),  by  using  (21)  we  obtain 


F(U,W(a))    = 


and 


F(V(a),W(a))    = 


2.393      1.72         10  0 

3.077      2.429      1.765      1  0 

3.236      2.761      2.174      1.63      1 


.538       .608       .72  0  0 

.398       .463       .472       .63         0 

0  0  0  0  0 


Then    using    (22)    and    (23) 


P(a)    = 


2.393  0  0 

1.655      3.077  0 

0.689      1.282      3.236 


and 


1(a)    =    (172.7      691.9      805.8) 
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Once   P(a)   and   £(a)   have  been  determined  they  can  be 
used  in  the  optimization  problem  P2  to  find  optimum  input  flows 
each  period.   Suppose  we  wish  to  measure  the  effect  of  a  change 
of  policy.   Let  us  assume  for  example  that  we  want  to  test  the 
effect  of  limiting  the  maximum  time  in  grade  2  to  3  periods, 
and  of  extending  the  maximum  time  in  grade  3  to  6  periods.   Then 
W(a),  V(a),  and   S   each  become  3x6  matrices.   But  (21)  can  be 
used  with  any  sized  matrices  and  so  (22)  and  (23)  readily  give  the 
new  values  of   P(a)   and  1(a)       for  use  in  resolving  P2.   The 

computational  speeds  involved  in  these  calculations,  including 

* 

solving  P2  and  determining   g  (t)  =  y(t)g,  are  of  the  order  1  or 

2  seconds  for  systems  with  about  10  grades  and  a  maximum  time 
in  grade  of  about  30  periods.   Thus  interactive  computer  models 
can  be  designed  so  that  the  manpower  planner  can  sit  at  a  terminal 
and  test  alternate  policies  or  design  manpower  systems. 
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